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EXECUTIVE  SUMMARY 


The  research,  conducted  under  this  grant  focused  on  the  development  and  analysis  of  the  generalized  hill 
climbing  algorithm  framework  as  a  tool  for  address  intractable  discrete  optimization  problems.  The 
major  technical  accomplishments  achieved  include 

i)  the  introduction  and  development  of  a  new  algorithm  classification  scheme  for 
generalized  hill  climbing  algorithms, 

ii)  the  formulation  of  new  necessary  and  sufficient  conditions  for  generalized  hill  climbing 
algorithms, 

Hi)  the  formulation  of  new  performance  measure  for  generalized  hill  climbing  algorithms, 
that  more  closely  matches  how  practitioners  apply  such  algorithms. 

iv)  the  formulation  of  a  new  necessary  convergence  condition  for  generalized  hill  climbing 
algorithms  using  these  new  performance  measures.  This  condition  resulted  in  a 
nonconvergence  proof  for  threshold  accepting,  hence  resolving  an  open  question  in  the 
literature. 

vj  the  benchmarking  of  generalized  hill  climbing  algorithms  using  the  new  performance 
measures,  resulting  in  a  base  convergent  rate  to  assess  the  value  of  such  algorithms. 

In  addition,  several  other  problems  were  studied  during  the  grant  period,  including  estimation 
procedures  and  complexity  results  for  discrete  event  simulation  problems,  aviation  security  system 
design  and  optimization  issues,  a  combinatorial  medical  problem,  and  a  flexible  assembly  system  design 
and  scheduling  problem.  All  the  accomplishments  are  documented  in  several  archival  journal  articles 
and  conference  proceedings.  In  addition,  many  of  the  results  have  been  presented  at  national  and 
international  conferences,  and  have  won  awards  for  their  contribution. 

Two  Ph.D.  dissertations  were  completed  during  the  period  of  the  grant.  Dr.  Kelly  Ann  Sullivan 
successfully  defended  and  submitted  her  Ph.D.  dissertation  "On  the  Convergence  of  Generalized  Hill 
Climbing  Algorithms"  in  May  1999.  Dr.  Diane  E.  Vaughan  successfully  defended  and  submitted  her 
Ph.D.  dissertation  "Simultaneous  Generalized  Hill  Climbing  Algorithms  for  Addressing  Sets  of  Discrete 
Optimization  Problem"  in  August  2000. 
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1.  Generalized  Hill  Climbing  Algorithms 

Generalized  hill  climbing  algorithms  (Johnson  1996,  Jacobson  et  al.  1998)  provide  a  well- 
defined  framework  to  model  algorithms  for  intractable  discrete  optimization  problems.  Generalized  hill 
climbing  algorithms  allow  inferior  solutions  to  be  visited  enroute  to  optimal  solutions.  This  hill  climbing 
capability  is  the  basis  for  the  search  strategy’s  name.  To  formally  describe  the  generalized  hill  climbing 
algorithm  framework,  several  definitions  are  needed. 

For  a  discrete  optimization  problem,  define  the  solution  space,  £2,  as  a  finite  set  of  all  possible 
solutions.  Define  an  objective  function  f:Q->  [0,+~]  that  assigns  a  non-negative  value  to  each  element 
of  the  solution  space.  An  important  component  of  GHC  algorithms  is  the  neighborhood  function,  T|:  £2 
2a,  where  t|(G))  c  £2  for  all  co  €  £2.  Solutions  in  a  neighborhood  are  generated  uniformly  at  each 
iteration  of  a  GHC  algorithm  execution  if,  for  all  coe  £2,  with  to’  e  t](g)), 

P{to’  is  selected  as  the  neighbor  of  to  at  a  given  iteration  of  a  GHC  algorithm}  =  1  /  I  r|(to)  | . 

Unless  otherwise  stated,  assume  that  the  neighbors  are  generated  uniformly  at  each  iteration  of  a  GHC 
algorithm.  The  GHC  algorithm  is  described  in  pseudo-code  form  (Jacobson  et  al.  1998): 

Set  the  outer  loop  counter  bound  K  and  the  inner  loop  counter  bounds  N(k),  k  =  1,2,. .  .,K 
Define  a  set  of  hill  climbing  (random)  variables  Rk:  £2  x  £2  — >  91  u  {-oo5+oo}5  k  =  1,2,...K 
Set  the  iteration  indices  i  =  0,  k  =  n  =  1 
Select  an  initial  solution  co(0)  £  £2 
Repeat  while  k  <  K 
Repeat  while  n  <  N(k) 

Generate  a  solution  a)  e  ri(w(i))  and  calculate  5(co(i),a))  =  f(to)  -  f(co(i)) 

If  Rk(aXi),w)  >  8(co(i),lo),  ther  w(i+l)  <—  to  (accept  improving  or  hill  climbing  moves) 
If  Rk(co(i),(o)  <  8(co(i),co),  the-  j)(i+ 1 )  <-  to(i)  (reject  hill  climbing  moves) 

n  < —  n+1,  i  < —  i+1 
Until  n  =  N(k) 
n  i —  1,  k  < —  k+1 
Until  k  =  K 

Note  that  the  outer  and  inner  loop  bounds,  K  and  N(k),  k  =  1,2, ...,K,  respectively,  may  all  be  fixed,  or  K 
can  be  fixed  and  the  N(k),  k  =  1,2,...,K,  are  random  variables  whose  values  are  determined  by  the 
solution  at  the  end  of  each  set  of  inner  loop  iterations  satisfying  some  property  (e.g.,  the  solution  is  a 
local  optima).  Moreover,  assume  that  the  hill  climbing  random  variables  have  finite  means  and  finite 
variances  for  all  k  and  for  all  possible  pairs  of  elements  in  the  solution  space  (i.e.,  E[Rk((o(i),(D)]  <  +°° 

K 

and  Var[Rk(co(i),o))]  <  +°°  for  all  co(i)  e  £2,  to€  ri(a>(i)),  and  for  all  k  =  1,2,. .  .,K,  i  =  1,2 . 1=2  N(k)). 

The  neighborhood  function  establishes  relationships  between  the  solutions  in  the  solution  space, 
hence  allows  the  solution  space  to  be  traversed  or  searched  by  moving  between  solutions.  To  ensure  that 
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the  solution  space  is  not  fragmented,  assume  that  all  the  solutions  in  the  solution  space  (with 
neighborhood  function  T))  are  reachable;  that  is,  for  all  co,co  there  exists  a  set  of  solutions  (Di, 

0)me  Q  such  that  to,  e  ti(oVi),  r  =  1,  2, m+1,  where  to'  =  too  and  to"  =  «W  Note  that  if  all  solutions  in 
a  solution  space  are  reachable,  then  the  solution  space  (with  neighborhood  function  T))  is  said  to  be 
reachable.  The  goal  is  to  identify  a  globally  optimal  solution  to*  (i.e.,  f(to*)  <  f(to)  for  all  to  e  Q). 

2.  Necessary  and  Sufficient  Convergence  Conditions 

One  accomplishment  during  the  term  of  this  grant  has  been  the  development  of  new  necessary 
and  sufficient  conditions  for  the  convergence  of  generalized  hill  climbing  algorithms.  Convergence 
conditions  provide  one  way  to  assess  the  value  and  effectiveness  of  an  algorithm.  These  results  are 
reported  in  Sullivan  (1999)  and  Sullivan  and  Jacobson  (2000a).  To  describe  these  conditions,  several 
additional  definitions  are  needed. 

The  objective  function,  f,  and  the  neighborhood  function,  r|,  allow  the  solution  space,  Q,  to  be 
decomposed  into  three  mutually  exclusive  and  exhaustive  sets: 

-  a  set  of  G-local  optima,  G  (the  set  of  global  optima), 

-  a  set  of  L-local  optima,  L  s  L(r|)  (the  set  of  local  optima  that  are  not  G-local  optima), 

-  a  set  of  hill  solutions,  H. 

Therefore  G  u  L  are  the  set  of  local  optima  in  Q  associated  with  neighborhood  function  r|,  where  by 
definition,  Q  =  GuLuH  with  GnL  =  0,  GnH  =  0,  and  L  n  H  =  0.  Note  that  by  definition,  for  all 
to  €  G,  ri(co)  n  L  =  0,  and  for  all  co  e  L,  r)(co)  n  G  =  0  (i.e.,  a  G-local  optimum  and  a  L-local  optimum 
cannot  be  neighbors  of  each  other). 

GHC  algorithms  can  be  viewed  as  sampling  procedure?  over  the  solution  space  Q.  The  key 
distinction  between  different  GHC  algorithms  is  in  how  the  sampling  is  performed.  For  example,  Monte 
Carlo  search  produces  unbiased  samples  (with  replacement)  from  the  solution  space,  while  simulated 
annealing  produces  biased  samples,  guided  by  the  neighborhood  function,  the  objective  function,  and  the 
temperature  parameter.  More  specifically,  simulated  annealing  can  be  described  as  a  GHC  algorithm  by 
setting  Rk(to(i),co)  =  -tkln(Vj),  co(i)  e  Q,  co  6  n(co(i)),  k  =  1,2,...,K,  where  tk  is  the  temperature  parameter 
(hence,  defines  a  cooling  schedule  as  tk-»  0)  and  {v,}  are  independent  and  identically  distributed  U(0,1) 
random  variables  (see  Johnson  1996,  Johnson  and  Jacobson  2001a,b  for  a  complete  discussion  on  and 
description  of  how  these  algorithms  fit  into  the  GHC  algorithm  framework). 

To  ensure  that  the  neighborhood  function  does  not  fragment  the  solution  space  (i.e.,  decompose 
the  solution  space  into  mutually  exclusive  subsets  of  solutions  that  are  not  reachable),  a  neighborhood 
function  ri  on  the  solution  space  Q.  is  said  to  have  the  local  search  property  if  when  local  search  (i.e., 
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Rk(co’,(o")  S  0  for  all  co’  e  Q,  to"  e  ti(co'),  k  =  1,2,... ,K)  is  applied  with  neighborhood  function  rj  to  the 
solution  space  Si,  then  for  all  {%€  H,  there  exists  (Ogul  e  GuL  such  that  the  local  search  algorithm  will 
terminate  in  (Ogul.  passing  only  through  elements  in  H.  Assume  that  all  neighborhood  functions  i) 
associated  with  a  GHC  algorithm  applied  to  solution  space  Si  have  the  local  search  property.  Note  that  if 
a  solution  space  (with  neighborhood  function  rj)  is  reachable,  then  r\  also  possesses  the  local  search 
property,  though  the  reverse  is  not  necessarily  true. 

K 

Each  execution  of  a  GHC  algorithm  generates  a  sequence  (sample)  of  I  =  £  N(k)  solutions.  In 

practice,  the  best  solution  obtained  over  the  entire  GHC  algorithm  run,  not  just  the  final  solution,  is 
reported.  This  allows  the  algorithm  to  aggressively  traverse  the  solution  space  visiting  many  inferior 
solutions  enroute  to  a  globally  optimal  solution,  while  retaining  the  best  solution  obtained  throughout  the 
entire  GHC  run.  Each  sequence  of  solutions  is  a  function  of  the  initial  solution,  w(0)e  Q,  and  two  sets  of 
independent  and  identically  distributed  U(0,1)  random  variables, 

j)  {£,},  that  generate  the  neighbors,  to  e  tl(co(i))  (hence,  allow  8(to(i),  co)  =  f(to)  -  f(co(i))  to  be 
computed)  at  each  iteration  i  =  1,2, 

if)  {v;},  that  generate  values  for  Rk(co(i),  co),  when  8(co(i),  co)  >  0,  to  determine  whether  the 
generated  neighbor  is  accepted  or  rejected  (i.e.,  R]((co(i),  co)  >  8(co(i),  co)  or  Rk(co(i),  co)  < 
8(co(i),  co),  respectively). 

Note  also  that  {^}  and  {Vj}  are  independent.  In  addition,  assume  that  when  comparing  different 
GHC  algorithms,  the  initial  solution  is  given  and  fixed  across  all  such  algorithms.  This  means  that 
({^},{Vi})  completely  define  the  probability  of  each  sequence  of  I  solutions  generate  by  a  GHC 
algorithm.  More  specifically,  let  X  s  X^o)  denote  all  sequences  of  I  solutions  generated  by  a  GHC 
algorithm,  where  each  of  the  I  solutions  is  in  Si,  3  denotes  the  sigma  field  of  events  on  X,  and  P  —  P^,v 
denote  the  probability  measure.  Therefore,  (X,  3,  P)  defines  a  probability  space  on  the  sequences  of  I 
solutions  generated  by  a  GHC  algorithm,  where  this  probability  space  is  characterized  by  the  initial 
solution,  oXO),  and  the  set  of  independent  and  identically  distributed  U(0,1)  random  variables,  ({£i},{Vj}), 
that  determine  the  sequence  of  I  solutions  generated  by  a  GHC  algorithm.  For  simplicity  and  ease  of 
notation,  o)(0)  and  ({^},{Vj})  will  be  suppressed,  unless  they  are  needed  to  avoid  ambiguities. 

The  iterations  of  a  GHC  algorithm  can  be  classified  as  either  micro  or  macro  iterations  (Sullivan 
1999).  A  micro  iteration  moves  the  algorithm  from  the  current  solution  either  to  an  immediate  neighbor 
or  back  to  itself.  A  macro  iteration  is  a  set  of  micro  iterations  that  moves  the  algorithm  from  any 
element  of  G  u  L  to  any  element  of  G  u  L  (including  itself),  passing  only  through  elements  of  H. 
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Using  these  definitions,  at  macro  iteration  k  (fixed),  the  micro  iterations  define  a  homogeneous 
discrete  time  Markov  chain,  with  micro  iteration  transition  matrix 


'p*(G,G)  P*(G,L)  Pk(G,H) 
Pkm(L,G )  Pk  (L,  L)  Pk  (L,H) 
Pk(H,G )  Pk  {H ,  L)  Pkm(H,H) 


where  (U,V),  U,Ve{G,L,H)  are  |U|x|V|  matrices  representing  the  micro  iteration  transition 
probabilities  from  the  elements  in  set  U  to  the  elements  in  set  V.  Note  that  if  the  micro  iteration  transition 
Markov  chain  is  aperiodic  and  irreducible,  then  at  macro  iteration  k,  the  macro 


'  M 


P, *  (G,  //)(/  -Pk  (H,H))-'  Pk  ( H,G )  +  Pk  (G,  G) 
Pk  a,  H)(I  -  P k  (H,H)) -1  Pk  ( H,G)  +  Pk  (L, G) 


Pk  (G,  H)(I  - Pk  ( G,H )) -1  (H ,  L)  +  Pkm  (G,  L) 
Pm  (L,  H)(I  -  Pkm  Pk  ( H,L)  +  Pkm  (L,  L) 


iterations  define  an  inhomogeneous  Markov  chain,  with  macro  iteration  transition  matrix. 

Without  loss  of  generality,  assume  that  the  GHC  algorithm  run  is  initialized  at  a  solution  in  L 
(i.e.,  (0(0)  e  L),  since  local  search  can  be  applied  from  any  element  in  Q,  and  the  local  search  property 
holds  for  the  solution  space  Q.  This  places  a  restriction  on  the  classes  of  discrete  optimization  problems 
that  can  be  studied,  since  if  a  local  optima  cannot  be  obtained  in  polynomial  time  in  the  size  of  the 
problem  instance,  then  initializing  the  GHC  algorithm  run  in  this  way  may  not  be  feasible  (see  Jacobson 
and  Solow  1993).  In  addition,  if  local  search  is  applied  and  the  local  optima  obtained  is  a  G-local 
optima,  then  the  problem  is  solved,  though  this  may  not  be  known  until  further  algorithm  iterations  are 
executed. 

To  illustrate  the  micro  iteration  and  macro  iteration  concepts,  from  the  GHC  algorithm  pseudo¬ 
code,  let  the  outer  loops  represent  macro  iterations,  while  the  inner  loops  represent  micro  iterations 
between  the  macro  iterations.  Therefore,  as  the  GHC  algorithm  is  now  defined,  there  will  be  K  macro 
iterations,  with  N(k)  micro  iterations  associated  with  macro  iteration  k  =  1,  2,  ....  K  (i.e.,  N(k)  micro 
iterations  between  macro  iteration  k-1  and  k,  where  the  0th  macro  iteration  is  defined  as  the  initialization 
of  the  GHC  algorithm  run  at  co(0)  e  L).  Note  that  all  the  solutions  visited  during  the  N(k)  micro 
iterations  associated  with  macro  iteration  k  will  be  in  H,  and  that  N(k),  k  =  1,2,...,K,  will  be  random 
variables. 

To  obtain  the  necessary  and  sufficient  convergence  conditions  for  a  GHC  algorithm  to  converge, 
define  to  be  the  long  run  stationary  distribution  of  a  GHC  algorithm  being  at  solution  toeGuL  at 
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Using  these  definitions,  at  macro  iteration  k  (fixed),  the  micro  iterations  define  a  homogeneous 
discrete  time  Markov  chain,  with  micro  iteration  transition  matrix 


Fm*(G,G)  P*  (G,L)  P*  (G,H) 
Pm(L>G)  P*  (L,  L)  P*(L,H) 
P*(H,G)  P* (H , L)  P*(H,H) 


where  P^(U,V),  U,Ve{G,L,H}  are  |U|x|V|  matrices  representing  the  micro  iteration  transition 
probabilities  from  the  elements  in  set  U  to  the  elements  in  set  V.  Note  that  if  the  micro  iteration  transition 
Markov  chain  is  aperiodic  and  irreducible,  then  at  macro  iteration  k,  the  macro 


M 


P*  (G,  H )(/  -  Pi  (H,H)) -1  Pi(H,G)  +  Pi  (G, G) 
Pi  ( L,H)(l  -  Pi  (//,//)) Pi(H,G)  +  Pi  (L,  G) 


Pi  0 G,H)(I  -  Pi  (G,  //))-'  Pi  ( H,L)+Pi  (G,  L) 
Pi  (L,H)(I  -  Pi  (//,//))-'  Pi  (H ,L)+  Pi  (L,  L) 


iterations  define  an  inhomogeneous  Markov  chain,  with  macro  iteration  transition  matrix. 

Without  loss  of  generality,  assume  that  the  GHC  algorithm  run  is  initialized  at  a  solution  in  L 
(i.e.,  (0(0)  e  L),  since  local  search  can  be  applied  from  any  element  in  Q,  and  the  local  search  property 
holds  for  the  solution  space  £2.  This  places  a  restriction  on  the  classes  of  discrete  optimization  problems 
that  can  be  studied,  since  if  a  local  optima  cannot  be  obtained  in  polynomial  time  in  the  size  of  the 
problem  instance,  then  initializing  the  GHC  algorithm  run  in  this  way  may  not  be  feasible  (see  Jacobson 
and  Solow  1993).  In  addition,  if  local  search  is  applied  and  the  local  optima  obtained  is  a  G-local 
optima,  then  the  problem  is  solved,  though  this  may  not  be  known  until  further  algorithm  iterations  are 
executed. 

To  illustrate  the  micro  iteration  and  macro  iteration  concepts,  from  the  GHC  algorithm  pseudo¬ 
code,  let  the  outer  loops  represent  macro  iterations,  while  the  inner  loops  represent  micro  iterations 
between  the  macro  iterations.  Therefore,  as  the  GHC  algorithm  is  now  defined,  there  will  be  K  macro 
iterations,  with  N(k)  micro  iterations  associated  with  macro  iteration  k  =  1,  2,  ....  K  (i.e.,  N(k)  micro 
iterations  between  macro  iteration  k-1  and  k,  where  the  0th  macro  iteration  is  defined  as  the  initialization 
of  the  GHC  algorithm  run  at  co(0)  e  L).  Note  that  all  the  solutions  visited  during  the  N(k)  micro 
iterations  associated  with  macro  iteration  k  will  be  in  H,  and  that  N(k),  k  =  1,2,...,K,  will  be  random 
variables. 

To  obtain  the  necessary  and  sufficient  convergence  conditions  for  a  GHC  algorithm  to  converge, 
define  to  be  the  long  run  stationary  distribution  of  a  GHC  algorithm  being  at  solution  coeGuL  at 
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macro  iteration  k.  The  following  lemma  provides  upper  and  lower  bounds  on  the  sum  of  the  long  run 
stationary  distribution  of  being  at  a  solution  in  L  at  macro  iteration  k. 

Lemma  1  (Sullivan  and  Jacobson  2000a):  For  a  GHC  algorithm  at  macro  iteration  k  (fixed),  with  macro 
iteration  transition  matrix  , 


nun 

weG 


creL 


max 

weG 


i 

creL 


(co, a) /[min  Y  Pm (a,o)  +  max  £  Pm (o,co)] 

“*G  £1  <weG 

n*< 

t oeL 

Pm  (co,a)  /  [  max  V  P^  (co,ct)  +  min  J  pm  (<*>“)] 

coeG 


creL 


weG 


These  bounds  are  used  to  provide  the  necessary  and  sufficient  convergence  conditions  for  a  GHC 
algorithm  to  converge  in  probability  to  G,  as  given  by  Theorem  1. 


Theorem  1  (Sullivan  and  Jacobson  2000a):  For  a  GHC  algorithm  at  macro  iteration  k  (fixed),  with 

.  T,k 

macro  iteration  transition  matrix  rM , 

a)  (Necessary  Condition) 

If  0  as  k  — >  -KO,  for  all  coeL,  then 

[min  V  P^ (co,c)] / [ max  V  Pm (ct,co)] -> 0 as k ->  +~, 

<ueG  £1  coeG 

b)  (Sufficient  Condition) 

If  [max  y  P^  (co,a)]  /  [  max  Y*  Pm(o),ci)  +  min  £  Pm(ct,m)]->0 
“*G  ftL  “C  osi. 

as  k  — >  +°o,  then  FI^  — » 0  as  k— >  +°°,  for  all  cogL. 

Theorem  1  uses  the  macro  iteration  structure  and  the  macro  iteration  transition  matrix  described  above  to 
provide  conditions  that  can  be  used  to  determine  when  a  GHC  algorithm  does  or  does  not  converge. 
These  conditions  are  being  studied  and  analyzed  to  determine  convergence  rates  for  different  classes  of 
GHC  algorithms,  as  well  as  to  determine  how  different  GHC  algorithm  formulations  can  be  compared 
and  evaluated  for  various  discrete  optimization  problems. 

3.  Performance  Measures 

An  important  breakthrough  has  been  the  development  of  the  false  negative  probability  for  GHC 
algorithms,  and  the  resulting  new  necessary  convergence  condition.  To  obtain  these  new  results,  several 
important  research  development  milestones  had  to  be  attained.  All  these  results  are  reported  in  Jacobson 
and  Yucesan  (2000a).  To  describe  these  developments,  a  number  of  additional  definitions  are  needed. 

Define  A  to  be  a  GHC  algorithm  applied  to  an  instance  of  a  discrete  optimization  problem,  where 
K  represents  the  total  number  of  macro  iterations  obtained  during  the  algorithms  execution.  Assume  that 
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for  A,  Rk((o(i),to)  >  0,  w(i)  e  Q,  ffl  e  r|(co(i)),  for  all  macro  iterations  k  =  1,2 . K.  At  each  macro 

iteration  k,  define  the  events  on  the  probability  space  (£,  3,  P), 

BA(k,G)  =  B(k,G)  s  {A  does  not  visit  any  element  of  G  after  k  macro  iterations}  (1) 
and 

Ba(G)  =  B(G)  =  {A  does  not  visit  any  element  of  G}.  (2) 

These  two  events  are  distinct  in  that  B(k,G),  k  =  1,2,..,,K,  are  for  algorithm  A  executed  over  a  finite 
number  of  macro  iterations  k,  while  B(G)  has  no  such  limitation.  The  complementary  events,  Bc(k,G) 
(termed  the  finite  global  visit  probability)  and  BC(G)  (termed  the  global  visit  probability),  are  defined  as 

Bc(k,G)  =  {A  visits  at  least  one  element  of  G  after  k  iterations }  (3) 

and 

BC(G)  =  {A  visits  at  least  one  element  of  of  G}.  (4) 

The  definition  of  B(k,G)  in  (1)  implies  that  B(k,G)  D  B(k+1,G),  for  all  macro  iterations 
k=l,2,...,K,  hence  (B(k,G)}  is  a  telescoping,  non-increasing  sequence  of  events  in  k.  Therefore,  since  the 
probability  function  is  a  continuous  set  function,  then  by  the  Monotone  Convergence  Theorem  (Ross 
1988,  p.44), 

P{B(K,G)}  —» P{B(G)}  as  K  — »  +°°, 

where 

B(G)  =  Q  B(k,G). 

After  K  macro  iterations,  algorithm  A  yields  K  solution7;,  {cOi,tO2,-  --,t0K}  c  G  u  L.  Define  f*  to 
be  the  minimum  objective  function  value  among  these  K  solutions  and  coK  to  be  the  associated  solution 

(i.e.,  f*  =  f(toK)  with  toK  =  argminffttOk),  k  =  1,2 . K}).  In  practice,  the  best  solution  to  date  (i.e.,  coK)  is 

reported.  The  key  issue  is  whether  coKe  G.  If  0)kg  G,  then  algorithm  A  would  be  terminated  at  (no  later 
than)  macro  iteration  K.  On  the  other  hand,  if  coK  g  G,  it  would  be  desirable  to  determine  whether 
algorithm  A  will  at  some  future  macro  iteration  find  any  solution  in  G.  In  this  case,  it  would  also  be 
desirable  to  determine  the  number  of  additional  macro  iterations  required  to  visit  such  a  solution.  The 
probability  that  coK  is  an  element  of  G,  P{toK  e  G},  is  given  by  P{BC(K,  G)}.  If  this  probability  is 
sufficiently  close  to  one,  then  algorithm  A  may  be  terminated.  Therefore  P{BC(K,  G)}  provides  a  quality 
measure  for  the  solutions  obtained  after  K  macro  iterations. 

To  establish  the  relationship  between  the  convergence  of  a  GHC  algorithm  and  B(G),  the 
following  definition  of  convergence  in  probability  is  formally  stated. 
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DEFINITION  1:  A  GHC  algorithm  A  converges  in  probability  to  G  if  P{C(K,G)}  — »  1  as  K  — »  +°°, 
where  CA(K,G)  =  C(K,G)  =  {A  is  at  an  element  of  G  at  macro  iteration  K}  =  {(Ok  e  G}. 

Therefore,  for  a  given  (fixed)  initial  solution  co(0),  if  algorithm  A  converges  in  probability  to  G  (as  K 
+e°),  then  P{BC(G)}  =  1.  Equivalently,  if  P{BC(G)}  <  1,  then  algorithm  A  does  not  converge  in 
probability  to  G  (i.e.,  there  exists  some  e  >  0  and  a  macro  iteration  Ko  such  that  P{C(K,G)}  <  1  -  e  for  all 
K  >  Ko).  The  convergence  behavior  of  GHC  algorithms  is  further  investigated  in  Section  4. 

In  light  of  these  observations,  the  false  negative  problem  asks  whether  a  GHC  algorithm  A  will 
eventually  visit  an  element  of  G,  given  that  the  algorithm,  after  executing  a  finite  number  of  macro 
iterations,  has  yet  to  visit  an  element  of  G.  This  question  can  be  quantified  by  considering  the  false 
negative  probability  at  macro  iteration  K,  P{BC(G)  I  B(K,G)}. 

The  false  negative  probability  at  macro  iteration  K  provides  a  measure  for  the  effectiveness  of  a 
GHC  algorithm  A,  namely  the  ability  of  algorithm  A  to  visit  an  element  of  G  beyond  macro  iteration  K. 
In  particular,  if  P{BC(G)}  is  small,  then  one  can  use  the  false  negative  probability  to  assess  whether  a 
GHC  algorithm  will  eventually  visit  an  element  of  G;  if  the  false  negative  probability  at  macro  iteration  K 
is  sufficiently  close  to  zero,  then  the  algorithm  may  be  terminated. 

The  false  negative  probability  at  macro  iteration  K  can  be  related  to  the  Type  II  error  in  a 
hypothesis  testing  framework.  To  see  this,  consider  the  following  hypotheses  in  the  search  for  a  globally 
optimal  solution  using  a  GHC  algorithm: 

Ho:  There  does  not  exist  a  solution  toe  Q  with  objective  function  value  at  or  below  0 

(i.e.,  f(co)  >  0  for  all  0)  e  Q), 

Ha:  There  exists  a  solution  toe  Q  with  objective  function  value  at  or  below  0 

(i.e.,  f(to)  <  0  for  some  to  6  Q), 

where  0e  R.  If  0  =  f(co*),  (0*e  G,  then  by  viewing  the  GHC  algorithm  A  as  a  sampling  procedure  over  the 
solution  space,  Q,  a  Type  I  error  cannot  occur,  since  if  algorithm  A  finds  a  solution  with  objective 
function  value  at  or  below  0,  then  Ho  cannot  be  falsely  rejected.  However,  a  Type  II  error  can  occur,  with 
probability  pK  =  P{B(K,G)}.  Using  the  law  of  total  probability  and  Bayes  Theorem,  the  probability  of  a 
false  negative  can  be  expressed  as  P{BC(G)  I  B(K,G)}  =  1  -  P{B(G)}  /  Pk-  This  relationship  suggests 
three  possible  cases: 

Case  a:  P{BC(G)}  =  0.  This  is  the  case  where  algorithm  A  is  guaranteed  to  never  visit  any  element  of  G, 
irrespective  of  the  number  of  macro  iterations.  For  this  situation,  the  false  negative  probability  is 
zero  for  all  macro  iterations  k  =  1,2,...,  since  pk  =  1  for  all  k  =  1,2,.... 
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Case  b:  P{BC(G)}  =  1.  This  is  the  case  where  algorithm  A  is  guaranteed  to  visit  an  element  of  G, 
provided  that  a  sufficiently  large  number  of  macro  iterations  are  executed.  For  this  situation,  the 
false  negative  probability  is  one  for  all  macro  iterations  k=l,2,.... 

Case  c:  0  <  P{BC(G)}  <  1.  This  is  the  case  where  algorithm  A  may  visit  an  element  of  G,  though  this 
cannot  be  guaranteed.  For  this  situation,  the  false  negative  probability  is  between  zero  and  one 
for  all  macro  iterations  k  =  1,2,...,  since  P{B(G)}  <  pk  for  all  macro  iterations  k=l,2,.... 
Moreover,  the  false  negative  probability  is  inversely  related  to  the  power  of  the  test,  1  -  Pk  (i.e., 
the  GHC  algorithm's  ability  to  visit  an  element  of  Q  with  objective  function  value  at  or  below  0). 

Each  of  these  three  cases  is  encountered  in  practice.  Case  a  occurs,  for  example,  if  the  algorithm  is  a 
local  search  procedure  and  with  probability  one  gets  trapped  in  a  L-local  optimum.  Case  b  occurs,  for 
example,  if  the  algorithm  is  Monte  Carlo  search  or  simulated  annealing  with  a  convergent  cooling 
schedule.  Case  c  occurs,  for  example,  if  the  algorithm  is  simulated  annealing  with  a  cooling  schedule  that 
does  not  guarantee  convergence. 

The  false  negative  probability  can  be  used  to  derive  necessary  convergence  conditions  for  GHC 
algorithms.  The  false  negative  probability  is  also  used  to  measure  the  effectiveness  of  non-convergent  (in 
probability)  GHC  algorithms.  Recall  that  P{B(0,  G)}  =  1  (i.e.,  all  GHC  algorithm  runs  are  initialized  at 
an  element  of  L,  hence  co(0)  e  L).  Furthermore,  unless  otherwise  stated,  assume  that  P{Bc(k,  G))  <  1  for 
all  macro  iterations  k  =  1,2,...,K. 

For  macro  iteration  k,  define  the  event 

RA(k,G)  =  R(k,G)  =  {A  visits  any  element  of  G  after  k  macro  iterations,  given  that  A 

has  not  visited  any  element  of  G  after  k-1  macro  iterations},  (5) 

where 

r(k,G)  =  P{R(k,G)}  =  P{Bc(k,G)  |  B(k-1,G)}  =  P{C(k,G)  I  B(k-1,G)}.  (6) 

This  probability  can  be  used  to  quantify  the  false  negative  probability.  Lemma  2  expresses  the 
relationship  between  (6)  and  (1). 

K 

LEMMA  2:  (i)  P{B(K,G)}  =  n  [1  -  r(k,G)]  for  all  macro  iterations  K. 

*=i 

(ii)  P{B(G)}=  n  [1  -  r(k,G)]. 

*=i 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Lemma  3  provides  an  expression  for  definite  false  negative  probability,  P{BC(J,G)  |  B(K,G)},  J  >  K. 
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J 

LEMMA  3:  For  all  macro  iterations  J,K,  with  J>K,  P{BC(J,G)  I  B(K,G)}  =  1  -  0  U  _  r(k,G)]. 

k=K+\ 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Theorem  2  provides  a  closed-form  expression  for  the  false  negative  probability. 

THEOREM  2:  For  all  macro  iterations  K,  P{BC(G)  I  B(K,G)}  =  1-11  [l-r(k,G)]. 

k=K+\ 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Corollary  1  shows  that  the  false  negative  probability  is  non-increasing  in  K. 

COROLLARY  1:  For  all  macro  iterations  K,  P{BC(G)  I  B(K,G)}  >  P{BC(G)  |B(K+1,G)}. 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Corollary  1  establishes  that  the  probability  of  visiting  any  element  of  G  never  increases  with  each 
successive  macro  iteration  that  has  not  visited  any  element  of  G.  This  result  can  be  used  as  a  guideline 
for  execution  termination.  For  example,  consider  two  GHC  algorithms  Aj  and  A 2  that  are  not  guaranteed 
to  converge  in  probability  to  G.  If  after  K  macro  iterations,  suppose  that  algorithm  A,  has  a  smaller  false 
negative  probability  than  algorithm  A2,  though  the  best  solution  obtained  thus  far  by  algorithm  A,  has 
lower  objective  function  value  than  the  best  solution  obtained  thus  far  by  algorithm  A2.  Then,  if  one  of 
the  algorithms  must  be  terminated,  one  may  choose  to  terminate  algorithm  A2  since  its  performance  over 
K  macro  iterations  has  been  inferior  to  that  of  algorithm  Ai.  However,  since  the  false  negative 
probability  is  a  measure  of  future  performance ,  then  algorithm  Ai  should  be  terminated,  because 
algorithm  Ai  is  less  likely  than  algorithm  A2  to  visit  any  element  of  G  in  subsequent  macro  iterations, 
given  that  neither  algorithm  has  visited  any  element  of  G  after  K  macro  iterations.  Note  that  the  number 
of  micro  iterations  between  each  macro  iteration  must  also  be  taken  into  account  when  deciding  upon 
which  algorithm  to  terminate.  Initial  results  on  the  expected  value  for  this  measure  are  reported  in 
Jacobson  and  Yucesan  (2000a). 

Theorem  3  expresses  the  probability  that  a  GHC  algorithm  does  not  visit  any  element  of  G  (after 
K  macro  iterations),  given  that  it  eventually  does  visit  an  element  of  G  in  J  >  K  macro  iterations  (where  J 
could  be  infinite).  This  result  provides  a  marginal  value  measure  for  executing  additional  iterations. 

THEOREM  3:  For  all  macro  iterations  J,K,  with  J  >  K  and  P{BC(J,G)}  >  0, 

P{B(K,G)  |  BC(J,G)}  =  {  ft  [l-r(k,G)]  -  fl  [l-r(j,G)]}  /  {I-FI  [l-r(j,G)]}. 

*=1  j= 1  ;'= 1 

Proof:  See  Jacobson  and  Yucesan  (2000a). 
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COROLLARY  2:  For  all  macro  iterations  K  and  P{Be(G)}  >  0, 

P{B(K,G)  |  BC(G)}  =  {  n  [l-r(k,G)]-n  [l-r<j,0)]}  /  { 1-fi  [l-i(j.G)]}. 

*=1  ;=l  '  ;'=> 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Note  that  the  probability  in  Corollaiy  2  is  non-increasing  in  K.  Therefore,  for  all  e  >  0  (close  to  0),  there 
exists  a  macro  iteration  Ko,  such  that,  for  all  macro  iterations  K  >  Ko,  P{B(K,G)  I  BC(G)}  <  e.  This  can 
be  used  to  terminate  a  GHC  algorithm  once  the  probability  in  Corollary  2  is  sufficiently  small,  since  the 
marginal  value  of  each  additional  macro  iteration  is  negligible.  Moreover,  since  the  probability  that  an 
element  of  G  has  been  visited  over  the  first  Ko  macro  iterations,  given  that  an  element  of  G  is  eventually 
visited,  is  at  least  1-e,  then  it  is  unlikely  that  a  premature  termination  has  occurred. 

Theorem  4  provides  upper  and  lower  bounds  for  the  finite  false  negative  probability. 

THEOREM  4:  For  all  macro  iterations  J,K,  with  J  >  K,  and  r(k,G)  <  1  for  all  k  =  1,2,.  ..,J, 

1  -  exp{-  £  r(k,G)}  <  P{Be(J,G)  I  B(K,G)}  <  1  -  exp{-  £  [r(k,G)]  /  [1  -  r(k,G)]}. 

*=AT+1  *=K+ 1 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Corollary  3  provides  upper  and  lower  bounds  for  the  false  negative  probability. 

COROLLARY  3:  For  all  macro  iterations  K, 

-Ho 

1  -  exp{-  X  r(k,G) }  <  P{BC(G)  |  B(K,G)}  <  1  -  exp{-  £  [r(k,G)]  /  [1  -  r(k,G)]  }. 

*=K+ 1  k=K+ 1 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Proposition  1  establishes  the  relationship  between  convergence  in  probability  to  G  and  the  false  negative 
probability. 

PROPOSITION  1:  If  a  GHC  algorithm  A  converges  in  probability  to  G,  then  GHC  algorithm  A  visits  G 
in  probability  (i.e.,  P{BC(G)  |  B(K,G)}  =  1  for  all  macro  iterations  K  =  1,2,...). 
Proof:  See  Jacobson  and  Yucesan  (2000a). 

From  Proposition  1,  if  a  GHC  algorithm  converges  in  probability  to  G,  then  the  GHC  algorithm  A 
visits  G  in  probability.  Proposition  2  provides  necessary  and  sufficient  conditions  for  the  false  negative 
probability  to  be  one  for  all  macro  iterations. 

PROPOSITION  2:  A  GHC  algorithm  A  visits  G  in  probability  if  and  only  if 

+©o 

.  X  r(k,G)  =  +©°  for  all  macro  iterations  K  =  1 ,2, . . . . 

*=K+l 

Proof:  See  Jacobson  and  Yucesan  (2000a). 
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Proposition  3  establishes  the  relationship  between  the  false  negative  probability  and  P{BC(G)}. 

PROPOSITION  3:  A  GHC  algorithm  A  visits  G  in  probability  if  and  only  if  P{BC(G)}  =  1. 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Theorem  5  summarizes  the  relationship  between  the  global  visit  probability,  the  false  negative 
probabilities,  r(K,G),  and  convergence  in  probability  to  G. 

THEOREM  5:  For  a  GHC  algorithm  A,  consider  the  expressions 

(Dl)  P{C(K,G)}  -»  1  as  K  -»  (converges  in  probability  to  G). 

(D2)  P{BC(G)  |  B(K,G)}  =  1  for  all  macro  iterations  K  (visits  G  in  probability). 

(D3)  P{BC(G)}  =  1  (visits  G  in  probability). 

+oo 

(D4)  X  r(k,G)  =  +°°  for  all  macro  iterations  K. 

*=*+1 

Then,  (Dl)  =>  (D2)  <=>  (D3)  <=»  (D4). 

Proof:  Follows  from  Propositions  1,  2,  and  3. 

Theorem  5  provides  three  necessary  conditions  for  the  convergence  of  a  GHC  algorithm.  The 
only  restriction  on  how  the  GHC  algorithm  traverses  the  solution  space  is  that  P{B(K,G)}  >  0  for  all 

macro  iterations  K  =  1,2. .  This  restriction  means  that  the  GHC  algorithm  is  never  guaranteed  to  visit 

any  element  of  G  for  K  finite  (i.e.,  P{BC(K,G)}  <  1  for  all  macro  iterations  K  =  1,2,...). 

From  Lemma  1,  if  P{B(G)}  =  fj  [1— r(k,G)]  >  0,  then,  from  Theorem  5,  the  GHC  algorithm 

does  not  converge  in  probability  to  G.  Theorem  6  provides  an  ipper  bound  on  the  probability  associated 
with  the  GHC  algorithm  converging  in  probability  to  G. 

THEOREM  6:  For  a  GHC  algorithm  A,  P{C(K,G)}  <  1  -  \J/  for  all  macro  iterations  K  =  1,2 . where  \(/ 

=  n  [l-r(k,G)].  Therefore,  if  0  <  \|/  <  1,  then  GHC  algorithm  A  does  not  converge  in 

k=\ 

probability  to  G. 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Theorem  7  shows  that  for  a  GHC  algorithm  with  X  r(k,G)  <  +°°,  then  with  probability  one,  only  a  finite 

number  of  the  events  R(k,G),  k  =  1,2,...,  occur  simultaneously,  or  equivalently,  with  probability  zero,  the 
R(k,G),  k  =  1,2,...,  occur  infinitely  often. 


15 


THEOREM  7:  Suppose  that  for  a  GHC  algorithm  A,  X  r(k,G)  <  (hence,  the  algorithm  does  not 

*=1 

converge  in  probability  to  G).  Then  R(k,G),  k  =  1,2,...,  occur  finitely  often  with 
probability  one. 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

+«*» 

Theorem  7  shows  that  if  X  r(k,G)  <  +°°,  hence  the  GHC  algorithm  does  not  converge  in 

k=l 

+o°  'Hao 

probability  to  G,  then  for  all  e  >  0,  there  exists  a  K(e)eZ+  such  that  P{  (J  R(k,G)}  <  X  r(k,G)  <  e. 

k=K(e)  k=K  (f ) 

This  means  that  for  some  nonconvergent  (in  probability)  GHC  algorithms,  the  probability  that  it  will  visit 
an  element  of  G  for  the  first  time  (at  or  beyond  macro  iteration  K)  can  be  made  arbitrarily  small  if  the 
macro  iteration  K  is  set  sufficiently  large.  This  result  can  be  used  to  define  a  stopping  condition  for  a 
GHC  algorithm  run.  For  example,  if  an  improved  solution  has  not  been  observed  for  some  prespecified 
number  of  macro  iterations,  it  may  be  feasible  to  terminate  the  GHC  algorithm  run. 

Theorem  8  establishes  a  similar  result  as  Theorem  6  using  a  convergence  condition  on  the 
l-r(k,G),  k  =  1,2,.... 

THEOREM  8:  Suppose  that  for  a  GHC  algorithm  A,  X  (l-r(k,G))  <  +~>.  Then  R(k,G),  k  =  1,2,.!.  , 

t-i 

occur  almost  always  with  probability  one. 

Proof:  See  Jacobson  and  Yucesan  (2000a). 

Theorem  8  shows  that  if  X  (l-r(k,G))  <  +°°,  then  for  all  e  >  0,  there  exists  a  K(e)  e  7f  such 

*=i 

that  P{  R(K,G)}  >  P(  p|  R(k,G)}  >  1  -  X  (l~r(k,G))  >  1  -  e  for  all  K  >  K(e).  This  means  that  the 

k=K((C)  k  =  K(£) 

•hoc 

probability  that  a  GHC  algorithm  (with  X  (l-r(k,G))  <  +~)  will  visit  an  element  of  G  for  the  first  time 

*=i 

(at  or  beyond  macro  iteration  K)  can  be  made  arbitrarily  close  to  one  if  the  macro  iteration  K  is  set 
sufficiently  large. 

These  results  can  be  used  to  assess  the  performance  of  various  GHC  algorithms.  In  particular,  the 
performance  of  three  GHC  algorithms,  Monte  Carlo  search,  random-restart  local  search,  and  threshold 
accepting,  can  be  evaluated.  For  Monte  Carlo  Search,  Theorem  5  implies  that  the  false  negative 
probability  is  one  (for  all  macro  iterations)  for  Monte  Carlo  search.  To  see  this,  Monte  Carlo  search  can 
be  described  as  a  GHC  algorithm  by  setting  r|(to)  =  Q  for  all  coeQ,  and  Rk=  +°°  for  all  macro  iterations 
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k=l,2,....  If  p(G)  =  y/  (Y+^)>  then  r(k,G)  =  p(G).  Therefore,  P{B(k,G)}  -  [l-p(G)]  -  From  Lemma  2,  for 

macro  iterations  j  and  k,  with  j  >  k, 

P{Bc(j,G)  |  B(k,G)}  =  1  -  [l-p(G)] j'\ 

hence  the  finite  false  negative  probability  approaches  one  as  j  approaches  infinity.  Moreover,  from 
Theorem  5,  £  r(j,G)  =  §  p(G)  =  +°°  for  all  macro  iterations  k.  This  means  that  Monte  Carlo  search 

j=k+ 1  j=k+ 1 

visits  G  in  probability  as  k  approaches  infinity.  However,  P{C(k,G)}  =  p(G)  for  all  macro  iterations  k, 
hence,  Monte  Carlo  search  does  not  converge  in  probability  to  G.  More  specifically,  from  Theorem  5, 
(D2),  (D3),  and  (D4)  all  hold,  but  (Dl)  is  not  satisfied. 

Random-restart  local  search  combines  Monte  Carlo  search  and  local  search,  by  randomly 
selecting  a  new  initial  solution  every  time  a  local  search  algorithm  terminates  at  a  local  optimum.  The 
analysis  for  Monte  Carlo  search  also  shows  that  the  false  negative  probability  is  one  (for  all  macro 
iterations)  for  random-restart  local  search,  by  redefining  p(G)  to  be  the  probability  that  a  randomly 
generated  initial  element  of  Q  will  terminate  at  an  element  of  G.  Moreover,  random-restart  local  search 
will  not  converge  in  probability  to  G  (i.e.,  from  Theorem  5,  (D2),  (D3),  and  (D4)  all  hold,  but  (Dl)  is  not 
satisfied). 

Threshold  accepting  is  a  particular  GHC  algorithm  with  Rk(co(i),co)  =  Tk,  (o(i)eQ,  coerj(cD(i)),  for 
macro  iteration  k,  where  Tk  approaches  zero  as  k  approaches  infinity.  Therefore,  there  exists  an  e  >  0 
sufficiently  small  and  a  macro  iteration  ko  such  that  |  Tk  |  <  £  and  P(Rk(co(i),to)  ^  5(0)(i),(0)}=  0  for  all 
to(i)eL,  o>eri(CD(i)),  and  all  k  >  ko,  hence  (D4)  in  Theorem  5  does  not  hold.  This  implies  that  this 
particular  form  of  threshold  accepting  does  not  converge  in  probability  to  G.  However,  if  Tk  is  set  such 
that  it  does  not  approach  zero,  hence  r(k,G)  >  5  for  some  8  >  0  and  for  all  macro  iterations  k,  then  (D4)  in 
Theorem  5  may  hold  and  the  probability  of  a  false  negative  is  one  at  all  macro  iterations  k.  However, 
setting  Tk  in  this  way  may  not  be  feasible  in  practice,  since  it  requires  full  knowledge  of  the  solution 
space  (with  respect  to  the  depth  of  all  the  L-local  and  G-local  optima;  see  Hajek  1988). 

These  results  introduce  the  false  negative  probability  as  a  performance  measure  that  reflects  how 
effectively  a  GHC  algorithm  has  performed  to  date  as  well  as  how  effectively  a  GHC  algorithm  can  be 
expected  to  perform  in  the  future.  This  analysis  also  presents  expressions  and  bounds  for  the  false 
negative  probability  within  the  GHC  algorithm  framework.  Work  is  in  progress  to  determine  how  the 
false  negative  probability  can  be  used  to  develop  guidelines  to  design  effective  run  strategies  for  GHC 
algorithms  that  do  not  converge  in  probability  to  G.  These  guidelines  can  be  used,  for  example,  to 
determine  termination  conditions  once  the  marginal  value  of  additional  iterations  is  deemed  negligible. 
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Work  is  also  in  progress  to  extend  the  application  of  the  false  negative  probability  as  well  as  to  identify 
other  new  performance  measures  for  GHC  algorithms. 

4.  Benchmark  Results  for  Generalized  Hill  Climbing  Algorithms 

The  false  negative  probability  measure  for  GHC  algorithms  can  be  used  to  benchmark  the 
performance  of  GHC  algorithms.  This  resulted  in  new  necessary  and  sufficient  convergence  conditions, 
as  well  as  a  way  to  use  new  performance  measures  to  establish  benchmark  performance  criteria.  These 
results  are  reported  in  Jacobson  and  Yucesan  (2000b).  To  describe  these  results,  several  additional 
definitions  are  needed. 

Proposition  4  establishes  the  well  known  relationship  between  convergence  in  probability  to  G,  almost 
sure  convergence  to  G,  and  visits  G  infinitely  often. 

PROPOSITION  4:  Let  A  be  a  GHC  algorithm. 

i)  If  GHC  algorithm  A  converges  almost  surely  to  G  (as  the  number  of  macro  iterations 
approach  infinity),  then  algorithm  A  converges  in  probability  to  G. 

ii)  If  GHC  algorithm  A  converges  in  probability  to  G,  then  algorithm  A  visits  G  infinitely 
often. 

Proof:  See  Jacobson  and  Yucesan  (2000b). 

Proposition  5  provides  a  condition  on  the  hill  climbing  random  variables  such  that  i)  and  ii)  in 
Proposition  4  become  the  same. 

PROPOSITION  5:  Let  A  be  a  GHC  algorithm.  Suppose  that  there  exists  a  macro  iteration  Ko  such  that 
Rk(co,af)  =  0  with  probability  one  for  all  we  £2,  w’er|((o),  k  >  Ko-  Then  a  GHC 
algorithm  A  converges  almost  surely  to  G  (as  the  number  of  macro  iterations 
approaches  infinity)  if  and  only  if  it  visits  G  infinitely  often. 

Proof:  See  Jacobson  and  Yucesan  (2000b). 

From  Proposition  5,  if  for  GHC  algorithm  A  there  exists  a  macro  iteration  Ko  such  that  Rk(w,co’) 
=  0  with  probability  one  for  all  to  e  Q,  to’  €  rj(co(i)),  k  >  Ko,  then  convergence  almost  surely  to  G  and 
convergence  in  probability  to  G  are  identical.  Therefore,  if  a  GHC  algorithm  is  designed  to  become  pure 
local  search  after  some  finite  number  of  iterations,  then  convergence  in  probability  to  G  reduces  to 
almost  sure  convergence  to  G.  Moreover,  from  (4),  for  a  given  (fixed)  initial  solution  co(0),  if  algorithm 
A  converges  in  probability  to  G  (as  K  — »  +°°),  then  P{BC(G)}  =  1.  Equivalently,  if  P{BC(G))  <  1,  then 
algorithm  A  does  not  converge  in  probability  to  G  (i.e.,  there  exists  some  e  >  0  and  a  macro  iteration  Ko 
such  that  P{C(K,G)}  <  1-e  for  all  K  >  Ko)- 
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The  finite  global  visit  probability,  P{Bc(k,G)},  can  be  used  to  derive  necessary  and  sufficient 
convergence  conditions  for  GHC  algorithms.  Recall  that  P{B(0,G)}  =  1  (i.e.,  all  GHC  algorithm  runs  are 
initialized  at  an  element  of  L,  hence  to(0)  €  L).  Furthermore,  unless  otherwise  stated,  assume  that 
P{Bc(k,G)}  <  1  for  all  macro  iterations  k  =  1,2, 

The  one-step  macro  iteration  transition  probability,  r(k,G),  defined  in  (6)  is  used  to  obtain  the 
necessary  and  sufficient  convergence  conditions.  First,  Lemma  4  expresses  the  relationship  between  (6) 
and  (1). 

K 

LEMMA  4  (i)  P{B(K,G)}  =  fi  [1  -  r(k,G)]  for  all  macro  iterations  K. 

(iii)  P{B(G)}=  n  [1  -r(k,G)]. 

*=i 

Proof:  See  Jacobson  and  Y ucesan  (2000b). 

Theorem  9  provides  necessary  and  sufficient  conditions  for  a  GHC  algorithm  to  converge  in  probability 
to  G. 

THEOREM  9:  Let  A  be  a  GHC  algorithm.  Then  P{C(K,G)}  — >  1  as  K  — >  (i.e.,  converges  in 

probability  to  G)  if  and  only  if 

i)  1  r(K,G)  =  +~, 

K=1 

ii)  P(  Cc(K,G)  |  BC(K-1,G)}  -»  0  as  K  ->  +°°. 

Proof:  See  Jacobson  and  Yucesan  (2000b). 

Condition  i)  requires  that  *-(K,G)  not  converge  to  zero  too  quickly,  as  K  approaches  plus  infinity. 
This  means  that  the  conditional  probability  that  GHC  algorithm  A  visits  an  element  of  G  for  the  first  time 
at  macro  iteration  K  approaches  zero  sufficiently  slowly  such  that  the  infinite  summation  diverges. 
Condition  ii)  requires  that  the  conditional  probability  that  GHC  algorithm  A  visits  an  element  of  G  for 
either  the  second,  or  the  third,  or  up  to  the  K*  time,  including  the  K*  macro  iteration,  approaches  one  as 
the  number  of  macro  iterations  K  approaches  plus  infinity. 

If  a  GHC  algorithm  does  not  converge  in  probability  to  G,  then  conditions  i)  and  ii)  in  Theorem  9 
suggest  three  possible  cases: 

-H> © 

Case  1)  P{C(K,G)  |  B'(AM.G)}  ->0astf->+~,  but  X  r{K,G)  <  +~. 

K=1 

+0O  . 

In  this  case  X  r(K,G)  <  +°°  implies  that  P{Be(G)}  <  1. 

K=1 
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Therefore,  P{C(K,G)}  -»  P{B\G))  =  1  -ft  IMfcG)]  <  1  as  K->  +~. 

*=1 

Case  2)  if  *JCQ  =  +~,  but  P{C(K,G)  |  BC(A-1,G)}  -h  0  as  K ->  +~. 

K=1 

If  /,{CC(A',G)  |  Bc(/f-l,G)}  >  e  >  0  for  all  A"  >  A0  for  some  K0€ T,  then  there  exists  some  K,€  Z\ 
K>K0,  such  that  P{C(A,G)}  <  1-E  for  all  K  >  Kp 

Case  3)  X  HK,G)  <  +°°  and  P{C{K,G }  |  BC(A-1,G)}  -h  0  as  K  ->  +°°. 

K=1 

If  P{C(A,G)  |  BC(A-1,G)}  >  e  >  0  for  all  K  >  K0  for  some  K0eT,  then  there  exists  some  K,eT , 
K>K0,  such  that  then  P{C(/f,G)}  <  1  -  eP{Bc(G)}  +  e’(^;)  for  all  K  >  Kr  where  P{Bc(G)}>0 
and  e'(K,)  can  be  made  arbitrarily  small  for  Kt  sufficiently  large. 

For  Case  1),  P{C(K,G)}  converges  to  the  global  visit  probability,  as  AT  — >  +°°.  For  Case  2),  P{C(K,G)}  is 
bounded  above  by  one  minus  a  strictly  positive  lower  bound  for  P{C(K,G )  |  BC(A'-1,G)}.  For  Case  3), 
P{C(K,G)}  is  bounded  above  by  the  global  visit  probability  times  one  minus  a  strictly  positive  lower 
bound  for  P{C(A,G)  |  Bc(/f-l,G)}  (plus  a  value  that  can  be  made  arbitrarily  close  to  zero).  These  three 
cases  illustrate  the  relationship  between  the  global  visit  probability  and  the  convergence  in  probability  to 
an  element  of  G  of  a  GHC  algorithm. 

The  conditions  in  Theorem  9  can  be  related  to  the  convergence  conditions  for  simulated 
annealing  presented  in  Hajek  (1988).  In  particular,  Hajek  (1988)  shows  that  simulated  annealing 

converges  in  probability  to  the  set  of  global  optima  (i.e.,  G-loc?1  optima)  if  and  only  if  £  e'(d  /t(k))  =  +°°, 

k= 1 

where  t(k)  is  a  nonincreasing  cooling  schedule  at  iteration  k  (that  approaches  zero  as  k— >+°°),  and  d*  is 
the  maximum  depth  of  all  elements  in  L  (i.e.,  the  maximum  gap  in  objective  function  value  between  an 
element  of  L  and  the  solution  in  H  that  can  reach  another  element  of  LuG  via  local  search,  where  the 
maximum  is  taken  over  all  elements  of  L).  This  result  assumes  that  the  depth  of  all  elements  in  G  is 
infinity,  hence  once  a  G-local  optima  is  reached,  a  simulated  annealing  cannot  escape  (with  probability 
one)  from  such  an  element.  Therefore,  if  GHC  algorithm  A  is  simulated  annealing,  then  under  this 
assumption,  ii)  in  Theorem  9  is  always  satisfied.  Moreover,  since  the  solution  space  is  reachable,  then  at 
each  macro  iteration  K  sufficiently  large,  there  is  a  positive  probability  that  the  algorithm  will  need  to 
escape  from  each  element  of  L  and  move  to  an  element  of  G.  In  particular,  at  each  macro  iteration  K 
sufficiently  large,  the  conditional  probability  r(K,G  |  A)  has  a  component  that  includes  the  probability  of 
escaping  from  the  deepest  L-local  optimum.  Therefore,  using  the  law  of  total  probability. 
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r(K,G  I  A)  =  Za>eL  r(K,G  |  A,  toeL  is  visited  at  macro  iteration  K-l } 

P{toeL  is  visited  at  macro  iteration  K-l }  (7) 

Therefore,  there  exists  a  lower  bound  for  r(K,G  |  A)  that  is  a  linear  function  of  P{moving  from  the 

deepest  element  of  L  to  an  element  of  G}  =  P{  Accepting  hill  climbing  moves  out  of  the  deepest  element 

of  L  to  an  element  of  G}  =  0('(d,/t(K))),  since  the  hill  climbing  random  variable  at  macro  iteration  K  is 

+oo 

exponential  with  mean  1/  t(K).  Therefore,  a  sufficient  condition  for  i)  in  Theorem  9  is  £  e'(d*/t(K))  =  +°°. 

To  establish  that  this  infinite  summation  is  a  necessary  condition  for  i)  in  Theorem  9,  using  the 
same  analysis  as  described  above,  at  each  macro  iteration  K  sufficiently  large,  the  conditional  probability 
r(K,G  |  A)  has  a  component  (see  (7))  that  includes  the  probability  of  escaping  from  each  element  of  L. 
This  means  that  for  each  element  of  L,  there  exists  a  component  for  r(K,G  |  A)  that  is  0(e  ( (  v(  ))),  toeL, 
where  d(to)  is  defined  as  the  depth  of  the  L-local  optimum  to.  Therefore,  if  i)  in  Theorem  9  holds,  then 
the  infinite  summation  over  all  of  these  components  must  be  unbounded,  or  else  with  positive 
probability,  the  algorithm  visits  an  element  of  L  and  be  unable  to  move  from  it  to  another  element  of 

LuG.  This  means  that  £  r(K,G  |  A,  toeL  is  visited  at  macro  iteration  K-l}  =  +°°  for  all  toeL,  which 

K= 1 

establishes  that  £  e  :(d’/t(K>)  =  +«>  is  a  necessary  conditions  for  i)  in  Theorem  9. 

K =1 

The  finite  global  visit  probability  can  also  be  used  to  compare  different  GHC  algorithms.  In 
particular,  random  restart  local  search  (RR)  is  used  as  a  benchmark  algorithm  to  compare  the 
performance  of  various  GHC  algorithms.  Let  LS  denote  a  single  macro  iteration  (restart)  of  random 
restart  local  search.  Random  restart  local  search  involves  randomly  selecting  an  initial  solution  (i.e., 
uniformly  generated  over  the  entire  solution  space,  hence  for  all  toe  £2,  P{  Algorithm  LS  is  initialized  at 
ogQ}  =  1/|£2|),  and  applying  local  search  until  a  local  optimum  is  found.  This  process  is  repeated  until 
K  local  optima  are  obtained.  The  best  of  these  K  solutions  is  then  reported  as  the  final  solution. 
Therefore,  each  random  restart  corresponds  to  a  single  macro  iteration.  Using  the  GHC  algorithm 
framework  described  in  Section  2.1,  the  hill  climbing  (random)  variables  Ric(co(i),co)  =  0  for  all  to(i)  £  £2, 
to  e  ri(aXi)),  k  =  1,2, ...,K,  with  N(k)  representing  the  number  of  micro  iterations  needed  to  reach  the  k* 
element  of  LuG.  In  addition,  after  this  element  of  LuG  is  found,  a  new  element  of  £2  is  randomly 
(uniformly)  generated  to  begin  the  next  (inner  loop)  set  of  micro  iterations. 

To  show  how  random  restart  local  search  can  be  used  to  compare  different  GHC  algorithms,  at 
each  macro  iteration  (i.e.,  at  each  random  restart),  define  the  conditional  probability 

p(co)  =  P{  Algorithm  LS  terminates  in  G  |  Algorithm  LS  is  initialized  at  toe  £2}.  (8) 
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Using  the  law  of  total  probability,  define 


Similarly, 


P  { G-stop }  =  P  { Algorithm  LS  terminates  in  G } 

=  p(to)  *  P{  Algorithm  LS  is  initialized  at  to} 

weQ 

=  [  |G|  +  £  P(co)  ]  /  |Q|. 

weH 

P{  L-stop }  =  P{  Algorithm  LS  terminates  in  L } 

=  l-P{G-stop} 

=  [  |L|  +  X  d“P(CD))]/  |&|. 
oxzH 


(9) 


GO) 


Note  that  P{ L-stop}  is  defined  by  the  neighborhood  function  and  the  neighborhood  probability  mass 
function  (which  is  defined  to  be  uniform).  Therefore,  if  r|i  and  r\2  are  two  neighborhood  functions 
defined  on  a  solution  space  £ 2 ,  where  Tji(co)  c  T|2((o)  for  all  (0€  Q,  then  L(t|i)  2  L(t|2)  and  P{L-stop}  for 
ri,  is  greater  than  or  equal  to  P{ {L-stop}  for  r)2.  In  general,  enriching  the  neighborhood  function  such 
that  L-local  optima  are  eliminated  tends  to  decrease  P{L-stop}. 

Without  loss  of  generality,  assume  that  the  neighborhood  function  is  defined  such  that  P{L- 
stop}>0.  If  this  is  not  the  case,  then  P{G-stop}=l,  hence  local  search  will  always  find  a  G-local  optimum 
with  every  restart  (i.e.,  P{(Brr(K,G))c}=1  for  all  K=l,2,...).  Under  this  assumption,  Theorem  10 
provides  a  convergence  comparison  between  random  restart  local  search  and  a  GHC  algorithm  that  does 
not  visit  G  in  probability. 

THEOREM  10:  Let  A  be  a  GHC  algorithm  that  does  not  visit  G  in  probability.  Let  RR  be  a  random 
restart  local  search  algorithm.  If  the  neighborhood  function  and  the  neighborhood  probability 
generation  function  are  defined  on  the  solution  space  such  that  0<P{L-stop}<l,  then  there  exists 
a  macro  iteration  K„  (which  represents  the  number  of  restarts  for  the  random  restart  local  search 
algorithm)  such  that  for  all  K^K^, 

P{(Brr(K,G))c}  >  P{(Ba(K,G))c}. 

Moreover,  K_<ln[a]/ln[P{ L-stop}],  where  ff  (1  -  r(k,G))  >  coO. 

k=I 

Proof:  See  Jacobson  and  Yucesan  (2000b). 

Theorem  10  shows  that  if  a  GHC  algorithm  does  not  visit  G  in  probability,  then  there  exists  a  macro 
iteration  beyond  which  random  restart  local  search  yields  better  results,  as  measured  by  the  finite  global 
visit  probabilities  at  macro  iteration  K,  P{(BA(K,G))C}  and  P{(Brr(K,G))c}  (i.e.,  the  probabilities  that  the 
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best  solution  visited  to  date  (i.e.,  after  K  macro  iterations)  is  in  G,  for  algorithms  A  and  RR, 
respectively). 

Theorem  11  provides  sufficient  conditions  on  the  rate  at  which  P{BA(K,G)}  converges  to  zero 
such  that  the  performance  of  random  restart  local  search  and  a  GHC  algorithm  can  be  compared.  To 
described  these  conditions,  define  the  non-negative  value  cpo=  -ln(P{L-stop}). 

THEOREM  11:  Let  A  be  a  GHC  algorithm  that  visit  G  in  probability.  Let  RR  be  a  random  restart  local 
search  algorithm.  If  the  neighborhood  function  and  the  neighborhood  probability  generation 
function  are  defined  on  the  solution  space  such  that  0<P{L-stop}<l,  then 

i)  if  P{Ba(K,G)}  =  (Ke**)  for  K  large  and  tp>(p0,  then  there  exists  a  macro  iteration  Ko  such 
that  for  all  K  >  Ko,  P{(Brr(K,G))c}  <  P{(BA(K,G))C}, 

ii)  if  P{Ba(K,G)}  =  0(e*<pK)  for  K  large  and  tp<(p0,  then  there  exists  a  macro  iteration  Ko  such 
that  for  all  K  >  Ko,  P{(Brr(K,G))c}  >  P{(BA(K,G))e}, 

iii)  if  P{  Ba(K,G)  }  =  o(e'<t’K)  for  K  large  and  (p><Po,  then  there  exists  a  macro  iteration  Ko  such  that 
for  all  K  >  Ko,  P{(Brr(K,G))c}  <  P{(BA(K,G))C}, 

iv)  if  1/  P{BA(K,G)}  =  o(e<pK)  for  K  large  and  (p<<p0,  then  there  exists  a  macro  iteration  Ko  such 
that  for  all  K  >  Ko,  P{(Brr(K,G))c}  >  P{(BA(K,G))C}, 

where  P{BA(K,G)}  =  0(e‘<pK)  for  K  large  means  that  P{BA(K,G)}  e*  ->  a  constant  as  K— >  +°°, 
P(Ba(K,G)}  =  o(e‘<pK)  for  K  large  means  that  P{BA(K,G)}  e9*  -)  0  as  K->  +°°,  and 
1/P1Ba(K,G)}  =  o(e,pK)  for  K  large  means  that  1/[P{BA(K,G)}  e9*]  — >  0  as  K— >  +~. 

Proof  See  Jacobson  and  Yucesan  (2000b). 

Theorem  1 1  compares  the  performance  of  random  restart  local  search  and  a  GHC  algorithm  that  visit  G 
in  probability  for  four  different  cases.  The  remaining  two  cases  (i.e.,  P(BA(K,G)}  =  o(e‘<pK)  for  K  large 
with  cp«p0  and  1/P{BA(K,G)}  =  o(e9K)  for  K  large  with  cpxp0)  are  inconclusive,  hence  the  performance  of 
each  of  the  algorithms  becomes  problem  specific,  where  general  results  cannot  be  obtained  using  the 
approach  presented  here.  Note  that  an  identical  analysis  can  be  used  to  show  that  Monte  Carlo  search 
yields  the  same  conclusion  obtained  in  both  Theorems  10  and  1 1,  with  the  new  definitions  P{G-stop}  —  | 
G  |  /  |£  |  and  P{L-stop}  s  1  -  P{G-stop)  (i.e.,  P{L-stop}  is  no  longer  defined  as  in  (10)).  However, 
P{L-stop}  for  Monte  Carlo  search  will  be  greater  than  or  equal  to  P{L-stop}  for  random  restart  local 
search.  This  means  that  there  exists  GHC  algorithms  for  which  ii)  and  iv)  in  Theorem  1 1  are  satisfied  for 
random  restart  local  search,  but  are  not  satisfied  for  Monte  Carlo  search,  while  there  are  no  GHC 
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algorithms  that  converge  in  probability  for  which  the  reverse  is  true.  Therefore,  random  restart  local 
search  dominates  Monte  Carlo  search. 

The  results  in  Theorem  11  suggest  that  the  value  for  P{L-stop}  for  random  restart  local  search 
determines  its  relative  performance  with  GHC  algorithms  that  visit  G  in  probability.  In  particular,  if 
P{L-stop}=l,  then  ii)  and  iv)  can  never  be  satisfied.  This  means  that  random  restart  local  search  cannot 
be  proven  to  dominate  such  GHC  algorithms  using  Theorem  11.  In  general,  1-5  <  P{L-stop}  <  1  for 
some  5  >  0  close  to  zero.  Therefore,  (p0  =  -ln(P{L-stop})  >  -ln(l-5)  >  6.  This  means  that  the  larger  the 
value  for  P{L-stop}  (i.e.,  the  closer  to  one),  the  larger  the  number  of  restarts  needed  for  random  restart 
local  search  to  dominate  a  GHC  algorithm  that  visit  G  in  probability.  For  practical  purposes,  this 
suggests  that  for  solution  spaces  (and  associated  neighborhood  functions)  with  many  local  optima,  it  may 
be  more  effective  to  use  a  GHC  algorithm.  Therefore,  the  design  and  structure  of  the  neighborhood 
function  (hence  the  number  of  and  distribution  of  L-local  optima  in  the  solution  space)  is  a  key  factor  in 
determining  whether  random  restart  local  search  is  preferable  over  a  GHC  algorithm. 

The  results  in  Theorems  10  and  11  do  not  take  into  account  the  number  of  (micro)  iterations 
between  each  macro  iteration.  For  random  restart  local  search,  this  represents  the  number  of  iterations 
needed  to  reach  a  local  optimum  from  each  randomly  generated  initial  solution,  while  for  a  GHC 
algorithm,  this  represents  the  number  of  iterations  between  visits  to  local  optima.  Note  that  as  a  GHC 
algorithm  progresses,  and  the  hill  climbing  random  variables  approach  the  value  zero  with  probability 
one,  the  number  of  iterations  between  the  macro  iterations  may  be  very  small,  as  the  algorithm  gets  stuck 
in  the  same  local  optimum  with  increasing  probability.  If  this  local  optimum  is  a  L-local  optimum,  then 
P((Ba(K,G))c}  will  remain  constant  (oi  change  very  slowly)  for  all  future  macro  iterations.  Fox  (1993, 
1995)  notes  this  point  for  simulated  annealing,  and  suggests  alternate  ways  to  improve  the  performance 
of  simulated  annealing  that  overcomes  this  situation. 

The  results  in  Theorem  11  have  important  implications  for  practitioners  using  simulated 
annealing.  Using  the  necessary  and  sufficient  convergence  condition  for  simulated  annealing  in  Hajek 
(1988),  r(K,G)  can  be  bounded  above  and  below  by  functions  that  are  0(e  (d  /,(K)))  for  K  sufficiently 
large.  This  means  that  there  exists  constants  yl  >  0  and  y2  >  0  and  a  macro  iteration  Ko  such  that  yl  e 
(d-AdO)  <  r(K  G)  <y2e  «>  for  all  K  >  Ko.  Therefore,  for  all  K  >  Ko, 

n  (1  -  72  e  -<d*',00))  <  P{B$a(K,G)}  =  fl  [1- r(k,G)]  <f[  (1  -  yl  e  (11) 

I=i  *=i  *=i 

Hajek’s  condition  on  the  cooling  schedule  (and  indirectly,  through  the  choice  of  neighborhood  function 
which  defines  d*),  £  e'(d*/‘(K))  =  +°°,  places  restrictions  on  the  rate  at  which  the  cooling  schedule  t(k) 

K=1 
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approaches  zero.  Suppose  that  the  cooling  schedule  is  defined  such  that  e'(d  /t(K))  -  X(l/k)8  for  k>2  and 
XeZ*,  for  some  0  <  5  <  1.  Note  that  t(k)  could  also  be  define  using  iterated  logarithms  (e.g.,  e  = 
X(l/k(ln(k))  or  any  other  form  provided  that  Hajek’s  condition  is  satisfied. 

From  the  expression  in  (11),  one  can  obtain  an  upper  and  lower  bound  on  e9K  P{BSA(K,G)}  as  K— > 
+°°.  In  particular,  for  all  K  >  Ko, 

e9K  f[  (1  -  Y2  e  •(d’/t(,c)))  <  e9K  P{BSA(K,G)}  <  e9K  d  -  Yl  e  '(d*/t00)) 

*=i  *=i 

which  leads  to 

e9K  (1  - y2  X(l/k)8)  <  e<pK  P{BSA(K,G)}  <  e<pK  n(l- yl  X(l/k)5).  (12) 

*=i 

+~  +»  K 

Since  T~T  (1  -  yl  Xfl/k)8)  =  0  if  and  only  if  X  (1/k)8  =  +~,  then  the  rate  at  which  f]  0  “  Yl  ) 
if  K=1  *=> 

approach  zero  as  K— >  +oo  relative  to  the  rate  at  which  e9K  approaches  infinity  determines  which  of  the 

four  cases  described  in  Theorem  1 1  apply  to  this  simulated  annealing  algorithm. 

To  determine  this  rate,  note  that  for  some  kOeZ+  where  y2  X(l/kO)8<  1, 

K  K 

ln(fl  (1  -  yl  Xfl/k)8))  =  jr  ln(l  -  yl  Xfl/k)8)  <  ^  -YlX(l/k)8  (13) 

k=kO  k~kO  k=kO 

Using  the  integral  approximation  for  (14),  this  expression  is  <9(-ln(K))  as  K— >  +°°  for  8=1,  and  (^(-K1  6) 
as  K— >  +oo  for  0<8<1.  By  taking  the  exponential  function  in  (14),  then  Yl  (1  ~  Y1  ^(1/k)5)  is  O(lfK)  as 

k= 1 

K— »  +oo  for  5=1,  and  0(exp(KM))  as  K-»+~  for  0<5<1.  Therefore,  e9K  f|  0  “  Yl  >-(l/k)8)  ->  +~  as 

k=\ 

K->  +~  for  0<5<1.  The  same  conclusions  are  obtained  from  the  lower  bound  in  (12).  In  particular, 

ln(fj  (l-y2X(l/k)s))  =  X  ln(l-y2X(l/k)8)<  £  -  y2  X(l/k)8/(l- y2  Xd/k)8).  (14) 

k=kO  k=kQ  k=kO 

Once  again,  using  the  integral  approximation  for  (14),  this  analysis  yields  the  same  results.  Therefore, 
e”*  J“[  (l  —  y2  Xfl/k)8)  — >  +oo  as  K— »  -b»  for  0<8<1.  This  means  that  conditions  i),  ii),  and  iii)  cannot 

*=i 

hold  for  this  simulated  annealing  algorithm.  Therefore,  either  condition  iv)  holds  (provided  <p<(po),  hence 
random  restart  local  search  dominates  this  simulated  annealing  algorithm,  or  the  results  are  inconclusive 
(if  (p><Po).  Note  that  if  cp0  is  very  close  to  zero,  hence  P{L-stop}  is  very  close  to  one,  then  if  condition  iv) 
holds,  the  value  for  Ko  may  be  prohibitively  large,  by  comparing  e9K  with  functions  that  are  0(1/K)  or 
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OCexpCK8"1).  Therefore,  the  form  of  the  cooling  schedule  for  simulated  annealing  and  the  choice  of 
neighborhood  function  that  defines  the  value  for  P{L-stop}  for  random  restart  local  search  determine  the 
relative  performance  of  these  algorithms.  To  make  this  result  more  practical,  it  is  necessary  to  determine 
the  number  of  restarts/macro  iterations  Ko  that  are  needed  such  that  P{(Brr(K,G))c}  >  P{(BA(K,G))C}  for 
all  K  >  Ko;  this  is  a  topic  of  current  research  and  investigation. 

Note  that  the  vast  majority  of  theoretical  results  on  simulated  annealing  are  concerned  with  its 
asymptotic  convergence.  The  results  in  Theorems  10  and  1 1  suggest  that  random  restart  local  search  will 
outperform  simulated  annealing  provided  that  a  sufficiently  large  number  of  restarts  are  executed.  The 
primary  value  of  using  simulated  annealing  may  therefore  be  for  finite-time  executions  that  obtain  near- 
optimal  solutions  reasonably  quickly.  This,  in  turn,  suggests  that  one  should  focus  on  the  finite-time 
behavior  of  simulated  annealing  rather  than  the  asymptotic  convergence  results  that  dominate  the 
literature.  These  results  also  imply  that  the  primary  value  of  random  restart  local  search  is  when  it  is 
applied  over  an  infinite  horizon.  Work  is  in  progress  to  use  and  extend  these  results  to  identify  both 
convergent  and  nonconvergent  GHC  algorithm  formulations  that  perform  well  over  finite  horizons,  as 
well  as  determine  the  number  of  random  restarts  that  are  needed  to  satisfy  the  inequalities  in  Theorems 
10  and  11.  Moreover,  work  is  in  progress  to  determine  how  the  framework  provided  by  the  micro/macro 
iteration  structure  can  be  further  exploited  to  gain  insights  into  the  finite-time  and  asymptotic 
performance  of  GHC  algorithms  in  general. 

5.  Applications 

This  section  describes  results  in  applying  generalized  hill  climbing  algorithms  to  manufacturing 
process  design  optimization  problems  (Fischer  et  al.  1997)  of  interest  to  the  Air  For’er  This-  effort  has 
been  interdisciplinary,  involving  researchers  from  the  Materials  Process  Design  Branch  of  the  Air  Force 
Research  Laboratory  (Wright  Patterson  Air  Force  Base),  and  Austral  Engineering  and  Software,  Inc., 
(Athens,  Ohio).  Note  that.  The  research  and  algorithm  development  work  by  our  research  group  has 
been  transitioned  to  Austral  Engineering  and  Software,  Inc.,  hence  supporting  their  effort  under  a  Phase  II 
SBIR  through  the  Air  Force.  This  collaboration  between  an  Air  Force  Laboratory,  and  industrial  partner, 
and  an  academic  institution  has  been  highly  productive  and  extremely  synergistic  in  identifying  problems 
of  interest  to  the  Air  Force,  as  well  as  formulating  and  developing  solutions  to  address  such  problems. 

An  important  applied  development  has  been  the  formulation  of  a  hybrid  algorithm  that  crosses 
ordinal  optimization  with  generalized  hill  climbing  algorithms.  These  results  are  reported  in  Sullivan  and 
Jacobson  (2000b).  Ordinal  optimization  (Ho  et  al.  1992)  is  a  search  procedure  that  can  be  used  to  obtain 
optimal/near-optimal  designs  for  discrete  manufacturing  process  design  optimization  problems.  The 
strength  of  the  ordinal  optimization  approach  is  in  its  focus  on  finding  good  designs,  rather  than  trying  to 
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find  the  very  best  design  (i.e.,  goal  softening)  (Lee  et  al.  1998).  This  allows  ordinal  optimization  to 
reduce  sampling  over  a  very  large  design  space  (when  searching  for  an  optimal  design)  to  sampling  over  a 
smaller,  more  manageable,  set  of  good  designs  (see  Chen  and  Kumar  1996  for  an  application  of  ordinal 
optimization  to  a  discrete  optimization  problem).  The  strength  of  the  generalized  hill  climbing  algorithm 
is  in  its  intelligent  exploration  of  the  design  space  when  searching  for  an  optimal  design.  In  practice, 
generalized  hill  climbing  algorithms  find  good  designs  in  finite  time,  similar  to  ordinal  optimization. 

Ordinal  Optimization  is  an  algorithmic  approach  for  identifying  good  designs  over  a  large  design 
space.  By  relaxing  the  requirement  to  obtain  the  optimal  design,  hence  searching  for  designs  that  are  in  a 
small  percentage  of  the  best  designs,  the  algorithm  can  efficiently  weed  out  very  poor  designs  and 
identify  a  set  of  designs  (i.e.,  the  selected  subset)  among  which  there  exists  a  good  design  (i.e.,  an 
element  of  the  good  enough  subset).  The  quality  of  the  selected  subset  with  respect  to  the  good  enough 
subset  is  obtained  using  an  alignment  probability,  which  measures  the  probability  that  these  two  subsets 
contain  some  integer  value  number  of  overlapping  (common)  designs.  The  very  nature  of  relaxing  the 
optimization  requirement  in  this  way  has  suggested  the  term  soft  optimization  as  appropriate  for 
describing  the  execution  of  ordinal  optimization. 

By  relaxing  (or  softening)  the  optimization  requirement  for  ordinal  optimization,  a  fast  convergence 
rate  for  the  algorithm,  can  be  obtained.  In  particular,  Dai  (1996)  proves  that  the  ordinal  optimization 
convergence  rate  is  exponential  in  the  number  of  designs  selected.  He  shows  this  by  considering  a  set  of 
t  designs,  selected  independently  and  identically  over  the  entire  design  space,  and  defining  the  correct 
selection  (CS)  event  as  the  event  in  which  the  best  design  (over  the  t  selected)  is  indeed  the  best  overall 
design.  Then,  under  mild  restrictions,  P{CS}  is  shown  to  be  bounded  below  by  l-ae'p',  where  a  and  J5 
are  positive  constants.  Convergence  can  also  established  by  showing  that  the  alignment  probability 
converges  to  zero.  These  results  show  that  relaxing  an  algorithm’s  requirement  from  finding  the  overall 
best  design,  to  finding  a  design  in  some  top  percentile  of  all  designs  in  the  design  space,  results  in  a 
significantly  improved  rate  of  convergence. 

Using  the  strengths  of  both  ordinal  optimization  and  generalized  hill  climbing  algorithms,  a  new 
algorithm  is  proposed,  termed  ordinal  hill  climbing.  The  ordinal  hill  climbing  algorithm  is  a  particular 
type  of  generalized  hill  climbing  algorithm,  with  the  hill  climbing  component  of  the  generalized  hill 
climbing  algorithm  based  on  ordinal  information,  where  a  set  of  designs  are  collected  and  evaluated  at 
each  iteration  (similar  to  how  ordinal  optimization  is  applied).  In  particular,  the  algorithm  is  initialized 
with  a  set  (of  M)  selected  designs,  chosen  among  all  the  designs  in  the  design  space  (e.g.,  randomly).  At 
each  iteration  k,  a  hill  climbing  random  variable,  Rk,  defined  over  the  discrete  values  { 1,  2,  is 

generated  (Rk  =  rk)  and  used  to  keep  the  best  rk  designs  in  the  selected  set,  where  the  designs  in  the 


27 


selected  set  are  ordered  from  smallest  to  largest  cost,  with  best  referring  to  the  designs  with  smallest  cost. 
The  M-rk  open  spots  in  the  selected  set  are  then  filled  with  new  designs,  chosen  among  all  the  designs  in 
the  design  space,  or  using  some  rule  based  on  the  designs  that  were  kept  in  the  selected  set.  This  process 
is  iteratively  repeated  until  the  algorithm  terminates  (e.g.,  a  fixed  number  of  iterations  are  executed).  The 
ordinal  hill  climbing  algorithm  is  described  in  pseudo-code  form,  given  a  design  space,  £2,  and  a  cost 
function  (f)  and  a  neighborhood  function  r|  (if  needed)  defined  over  the  design  space. 

Se'ect  a  set  of  M  initial  designs  D( 0)  c  £2 

Set  the  iteration  number  k  =  0 

Define  the  hill  climbing  variable  Rk,  where 

i )  zVi  P{Rk  =  m}  =  1,  ii)  Ro  =  1  with  probability  one, 

Repeat 

Order  the  designs  in  D(k)  from  smallest  to  largest  cost  function  values 
Generate  Rk  (=  rk) 

Keep  the  best  (smallest  cost  function  value)  rk  designs  from  die  set  D( k).  Call  this  set  Ei. 
Generate  M-Rk  new  designs  from  the  design  space  £2.  Call  this  set  E2. 

Set  D(k+1)  <—  Ei  u  E2. 
k  <—  k+1 

Until  stopping  criterion  is  met 

There  are  several  parameters  that  must  be  initialized  for  the  ordinal  hill  climbing  algorithm.  First,  the 
value  of  M,  the  size  of  the  selected  design  sets,  D(k),  must  be  set.  Second,  the  initial  set  of  M 
manufacturing  process  designs,  D( 0),  can  be  selected  randomly  or  using  any  specified  selection  rule.  In 
addition,  there  are  two  features  of  the  algorithm  where  the  user  has  great  flexibility.  First,  the  hill 
climbing  variable  Rk  can  be  defined  as  any  discrete  (random  or  deterministic)  non-negative  variable 
defined  over  the  set  of  integers  (from  one  to  M).  Second,  at  each  iteration,  the  method  of  filling  in  the 
M-  rk  designs  in  the  selected  set  must  be  specified  (e.g.,  generate  neighbors  of  each  of  the  designs  that 
are  kept  in  the  selected  set). 

The  intuition  behind  ordinal  hill  climbing  algorithms  is  that  at  each  iteration,  the  best  designs, 
where  best  is  measured  using  the  value  of  the  cost  function  (smaller  cost  designs  are  better  than  larger 
cost  designs),  are  more  likely  to  become  part  of,  and  remain  in,  the  selected  design  set  £>(k).  The  hill 
climbing  variable  determines  the  acceptance  or  rejection  of  designs  in  the  design  set  based  on  their 
relative  costs  (i.e.,  ordinal  rank).  Therefore,  the  ranking  of  the  design  costs,  rather  than  the  costs 
themselves,  determines  whether  a  design  is  accepted.  For  example,  if  Rk  is  close  to  one  with  high 
probability,  as  in  the  early  stages  of  the  algorithm  execution,  then  most  of  the  designs  will  be  rejected 
from  the  selected  set  during  this  phase,  hence  guaranteeing  a  broad  (and  aggressive)  sampling  of  designs. 
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On  the  other  hand,  if  as  the  algorithm  progresses  Rk  is  more  likely  to  be  close  to  M,  then  the  algorithm 
will  tend  to  retain  good  designs  that  have  managed  to  remain  in  the  selected  design  set. 

In  light  of  this  observation,  a  possible  third  requirement  on  the  hill  climbing  variable  is  Rk  -»  M 
(with  probability  one)  as  k  -b».  As  the  algorithm  proceeds,  this  requirement  ensures  that  the  algorithm 
will  accept  an  increasing  number  of  designs,  until  at  termination,  when  P{lim  k_*+<»  Rk  =  M}  =  1,  the 
algorithm  accepts  all  of  the  designs  in  the  selected  design  set.  The  defining  feature  of  the  ordinal  hill 
climbing  algorithm  is  that  at  termination,  the  final  set  of  designs  is  likely  to  contain  a  good  design.  To 
identify  a  subset  of  this  final  set  of  designs  to  use,  ordinal  optimization  can  be  applied. 

There  are  a  number  of  ways  to  simplify  and/or  fine-tune  the  ordinal  hill  climbing  algorithm.  If  M 
is  set  to  one  at  all  iterations,  then  each  iteration  considers  only  a  single  design.  This  simplification 
reduces  the  ordinal  hill  climbing  algorithm  to  a  generalized  hill  climbing  algorithm.  There  are  an 
unlimited  number  of  choices  for  the  hill  climbing  variable,  Rk,  that  satisfy  the  requirements  listed  in  the 
ordinal  hill  climbing  pseudo-code.  There  are  also  numerous  ways  in  which  the  selected  design  set  can  be 
updated  from  D(k)  to  D(k+1),  depending,  for  example,  on  the  choice  of  neighborhood  function.  To 
illustrate,  this  update  can  be  done  using  multiple  neighbors  of  only  the  best,  or  near-best  (e.g.,  top  (3  *  M, 
where  |3  >  0  close  to  zero)  designs.  Stopping  criterion  that  can  be  used  for  the  ordinal  hill  climbing 
algorithm  include  looking  at  the  top  aM  designs,  with  a  >  0  close  to  zero,  and  stopping  the  algorithm  if 
this  top  aM  set  of  designs  does  not  change  over  some  specified  number  of  iterations.  Each  of  these 
modifications  results  in  a  large  selection  of  ordinal  hill  climbing  algorithm  variations  that  can  be  used  to 
address  the  an  integrated  blade  rotor  discrete  manufacturing  process  design  optimization  problem  of 
interest  to  the  Air  Force.  Computational  results  with  the  ordinal  hill  climbing  algorithm  applied  to  this 
problem  are  reported  in  Sullivan  and  Jacobson  (2000b). 

The  relationship  between  genetic  algorithms  and  ordinal  hill  climbing  algorithms  was  also 
studied.  Genetic  algorithms  (GA)  are  an  optimization  strategy  that  has  been  successfully  applied  to 
numerous  discrete  optimization  problems.  The  foundation  of  GA  is  derived  from  the  Darwinian  notion 
of  “survival  of  the  fittest”  (Reeves  1993);  this  notion  suggests  that  as  time  evolves,  parents  produce  new 
offspring  that  are  more  acceptable  than  members  of  previous  populations.  In  other  words,  over  a  period 
of  time,  parents  are  continually  mating  to  produce  successive  generations  of  children  that  are  closer  to 
optimality  than  their  predecessors. 

The  GA  ordinal  component  of  comparing  cost  function  values  over  a  set  of  children  (i.e., 
designs)  suggest  that  there  may  be  a  natural  bridge  between  GA  and  ordinal  hill  climbing  algorithms. 
Though  GA  have  proven  to  be  effective  for  addressing  intractable  discrete  optimization  problems,  and 
can  be  classified  as  a  type  of  hill  climbing  approach,  its  link  with  generalized  hill  climbing  algorithms 
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(through  the  ordinal  hill  climbing  formulation)  provides  a  well-defined  relationship  with  other 
generalized  hill  climbing  algorithms  (like  simulated  annealing  and  threshold  accepting).  Therefore,  such 
an  analysis  provides  useful  insights  and  observations  that  may  fuel  further  research  into  both  ordinal  hill 
climbing  and  genetic  algorithms,  and  how  they  fit  together  on  a  broader  scale. 

The  bridge  between  GA  and  the  ordinal  hill  climbing  algorithm  framework  is  defined  through  the 
hill  climbing  variable  Rk  and  the  method  by  which  each  successive  selected  subset  is  updated  (based  on  a 
neighborhood  function  definitions).  In  particular,  the  hill  climbing  variable  Rk  for  ordinal  hill  climbing 
algorithms  determines  the  number  of  parents  carried  over  from  the  selected  set  (population)  D(k)  to  the 
set  Ei.  Once  the  set  Ei  has  been  determined,  its  members  can  be  mated  (e.g.,  according  to  a  crossover 
rule)  to  produce  M-Rk  offspring.  Therefore,  the  GA  concept  of  mating  serves  as  the  neighborhood 
function  in  the  ordinal  hill  climbing  algorithm  framework.  This  set  of  M-Rk  offspring,  E2,  together  with 
the  set  Ej  becomes  the  next  selected  set  or  population  (i.e.,  D(k+1)  =  E]UE2). 

Basic  GA  consist  of  three  components: 

i)  Reproduction 

ii)  Crossover 

iii)  Mutation 

Reproduction  is  the  process  by  which  individual  parents  are  evaluated  for  mating  and  inclusion  in  future 
populations.  Variants  of  GA  can  be  described  by  employing  different  hill  climbing  variables  Rk  (i.e.,  the 
selection  of  parents  to  be  contained  in  E]  varies  with  the  choice  of  Rk).  Each  parent  in  a  population  is 
evaluated  according  to  its  cost  function  value.  In  general,  parents  with  good  (lower)  cost  function  values 
are  more  likely  to  be  among  the  Rk  selected  parents  for  the  set  Ei.  However,  for  diversification,  the  set 
E,  can  be  a  mix  of  both  good  and  bad  parents.  Crossover  is  £  process  by  which  offspring  are  generated 
based  upon  the  cost  function  values  of  the  parents.  A  particular  crossover  method  needs  to  be  defined 
before  the  GA  is  executed.  Crossover  may  consist  of  generating  a  neighbor  of  a  parent  in  Ej  to  produce 
offspring  or  combining  different  parts  of  two  parents  in  E,  to  produce  offspring. 

The  following  is  the  ordinal  hill  climbing  algorithm  formulation  of  simple  GA,  which  uses 
reproduction  and  crossover  components: 

Select  a  set  of  M  initial  designs  D(0)  c  Q 

Set  the  iteration  number  k  =  0 

Repeat 

Order  the  designs  in  D( k)  from  smallest  to  largest  cost  function  values 

Generate  Rk  (=  rk) 

Keep  the  best  (smallest  cost  function  value)  rk  designs  from  the  set  D(k)  as  parents  for  creating 
offspring.  Call  this  set  Ei. 

Generate  offspring  of  E]  according  to  the  crossover  rule  to  obtain  M-rk  new  designs.  Call  this  set  E2. 

Set  D(k+1)  <—  E,  u  Ej. 
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k  <—  k+1 

Until  stopping  criterion  is  met 

Mutation  involves  the  random  alteration  of  a  parameter  value  in  the  offspring.  Mutation  can  play 
either  a  primary  or  secondary  role  in  GA,  depending  on  the  desired  aggressiveness  of  GA.  If  the  entire 
population  has  cost  function  values  that  are  relatively  close  to  each  other,  the  search  may  easily  get 
caught  at  a  local  optimum.  In  this  situation,  it  may  be  desirable  to  increase  the  probability  of  mutation  to 
ensure  the  inclusion  of  designs  in  the  set  E,  sufficiently  different  from  those  already  in  the  population. 

The  following  is  the  ordinal  hill  climbing  formulated  simple  GA  with  a  mutation  component. 

Select  a  set  of  M  initial  designs  D(0 )  c  Q 

Set  the  mutation  probability 

Set  the  iteration  number  k  =  0 

Repeat 

Order  the  designs  in  D(k)  from  smallest  to  largest  cost  function  values 

Generate  Rk  (=  rk) 

Keep  the  best  (smallest  cost  function  value)  rk  designs  from  the  set  £>(k)  as  parents  for 
creating  offspring.  If  the  largest  and  smallest  cost  function  values  of  parents  among  these 
rk  values  are  relatively  close  to  each  other,  increase  the  mutation  probability,  hence  the 
diversity  of  the  parents  set.  Call  this  set  E]. 

Generate  offspring  of  Ei  according  to  the  crossover  rule  to  obtain  M— rk  new  designs. 

Call  this  set  £2. 

Set  D(k+1)  <-  Ej  u  E2. 

k  <—  k+1 

Until  stopping  criterion  is  met 

At  the  end  of  each  iteration,  the  new  population  becomes  the  population  of  parents  that  will  be 
used  to  perform  reproduction  and  crossover  to  generate  yet  another  new  population.  This  process  is 
repeated  until  the  algorithm  terminates;  at  termination,  the  final  population  will  (hopefully)  contain  an 
optimal  parent  (i.e.,  an  optimal  design). 

These  ordinal  hill  climbing  algorithm  formulations  for  GA  illustrate  the  power  and  flexibility  of 
the  ordinal  hill  climbing  algorithm  framework.  It  should  be  noted  that  by  defining  the  procedure  by 
which  the  selected  subset  in  ordinal  hill  climbing  algorithms  is  updated  without  a  neighborhood  function, 
it  is  possible  to  obtain  an  ordinal  hill  climbing  algorithm  formulation  that  is  not  a  GA  (such  as  by  simply 
randomly  generating  designs  to  obtain  set  £2).  Moreover,  problem-specific  implementations  for  GA  may 
not  fit  into  the  ordinal  hill  climbing  framework.  Further  research  is  needed  to  fully  assess  the 
relationship  between  ordinal  hill  climbing  algorithms  and  GA.  However,  the  two  formulations  presented 
provide  a  first  step  towards  developing  a  bridge  between  GA  and  other  search  strategies  like  simulated 
annealing,  threshold  accepting,  and  tabu  search  (Johnson  1996)  using  the  generalized  hill  climbing 
paradigm  (Johnson  and  Jacobson  2001a,b).  Moreover,  these  formulations  serve  to  illustrate  the  power  of 
the  ordinal  optimization  strategy  in  addressing  deterministic  discrete  optimization  problems. 
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Lastly,  several  on-site  meetings  and  interactions  with  Austral  Engineering  and  Software,  Inc.,  has 
resulted  in  further  enhancement  to  the  generalized  hill  climbing  algorithm  framework  and  software  that 
our  research  group  has  developed  for  their  use.  Moreover,  research  on  optimization  across  several 
manufacturing  process  design  optimization  sequence  (see  Vaughan  et  al.  2000)  has  resulted  in  a  new 
neighborhood  function  definition  and  form  that  has  the  potential  to  support  the  development  of  automated 
optimization  procedures  for  such  problems.  This  on-going  effort  of  developing  and  enhancing  the 
generalized  hill  climbing  algorithm  code,  in  conjunction  with  the  software  development  efforts  of  Austral 
Engineering  and  Software,  Inc.,  as  well  as  the  theoretical  work  being  undertaken  to  better  understand  the 
generalized  hill  climbing  algorithm  framework  and  how  to  exploit  its  form  to  improve  performance,  all 
serve  as  a  powerful  mechanism  for  transitioning  this  research  from  an  academic  environment  into  an 
industrial  setting. 

6.  Other  Research  Results 

In  addition  to  the  results  reported  with  generalized  hill  climbing  algorithms  and  discrete 
manufacturing  process  design  optimization  problems,  several  other  results  were  obtained  during  the 
period  of  the  grant.  These  results  are  briefly  discussed  here. 

Discrete  optimization  and  discrete  event  simulation  are  two  disparate  areas  within  the  general 
field  of  operations  research.  Building  a  framework  that  facilitates  the  cross-fertilization  of  tools  in  these 
two  areas  has  provided  much  of  the  motivation  and  basic  research  leading  up  to  the  creation  of  the 
generalized  hill  climbing  algorithm  paradigm.  Jacobson  and  Yucesan  (1999)  formulate  four  search 
problem  for  discrete  event  simulation  models  and  prove  them  to  be  NP-hard.  These  problems  consider 
fundamental  issues  faced  by  simulation  practitioners  (e.g.,  can  a  state  be  accessed,  does  changing  the 
order  of  events  impact  the  states,  does  representing  the  same  simulation  model  on  a  computer  in  two 
different  ways  result  in  different  states  when  executed,  can  a  simulation  run  stall,  how  do  permutations  of 
events  impact  the  states  and  future  events  lists,  or  how  events  are  cancelled,  resulting  in  a  loss  of 
information).  The  first  problem,  termed  ACCESSIBILITY,  is  a  generalization  of  the  discrete 
manufacturing  design  problems  briefly  described  in  Section  5. 

Fleischer  and  Jacobson  (1999)  consider  how  information  theory  can  be  used  to  assess  the  finite¬ 
time  performance  of  the  simulated  annealing  algorithm.  These  results  provide  insights  into  how 
simulated  annealing  can  be  executed  to  optimize  its  effectiveness.  Jacobson  and  Schruben  (1999)  look  at 
how  harmonic  analysis  can  be  used  to  perform  sensitivity  analysis  of  steady  state  discrete  event 
simulation  models.  Kumar  et  al.  (2000)  present  an  analysis  of  a  scheduling  optimization  problem 
associated  with  flexible  assembly  systems.  Jacobson  et  al.  (2000,  2001)  analyze  access  control  security 
systems  using  mathematical  programming  techniques  and  formulations.  Jacobson  and  Mortice  (1998) 
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study  a  combinatorial  medical  problem  that  evaluates  the  temporal  association  between  health  disorders 
and  medical  treatments. 
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Air  Force  Base. 
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